Spatial small-world networks: a wiring-cost perspective 
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Supplementing a lattice with long-range connections effectively models small-world networks char- 
acterized by a high local and global interconnectedness observed in systems ranging from society to 
the brain. If the links have a wiring cost associated to their length Z, the corresponding distribution 
q(l) plays a crucial role. Uniform length distributions have received most attention despite indica- 
tions that q(l) ~ l~ a exist, e.g. for integrated circuits, the Internet and cortical networks. Here we 
discuss for such systems the emergence of small- world topology, its relationship to the wiring costs, 
the distribution of flows as well as the robustness with respect to random failures and overload. The 
main finding is that the choice of such a distribution leads to favorable attributes in most of the 
investigated properties. 

PACS numbers: 89.75.-k, 89.75. He, 87.19.La 
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The explosion of research activity in the field of com- 
plex networks has led to a novel framework in order to 
describe systems in disciplines ranging from the social 
sciences to biology Q. One feature shared by most real 
networks is the small-world (SW) property namely ev- 
ery pair of nodes is separated, on the average, by only 
a few links Q{. Although the SW phenomenon has first 
been introduced in a social context it is also rele- 
vant for communication and technological systems such 
as the Internet Q or electronic circuits [f| . A more pre- 
cise definition of the SW topology implies not only a 
short distance between every pair of nodes, but also a 
high degree of local interconnectedness, that is, for every 
node, most nodes close to it should also be close to each 
other. Such properties are of great relevance for commu- 
nication systems: SW networks are particularly efficient 
for message passing protocols that rely only on the lo- 
cal knowledge of the network available to each node 
It has also been recently pointed out that SW networks 
could describe the architecture of neural networks: in 
vitro neuronal networks Q , brain functional networks || 
as well as the cerebral cortex 

9] 

exhibit SW features. In 
fact, the topology plays a crucial role in a neural network, 
since the high local interconnectedness gives rise to co- 
herent oscillations while short global distances ensure a 
fast system response [Tof . 

Network possessing both of the relevant SW proper- 
ties can be realized as follows starting from a regular 
(or homogeneous) distribution of nodes in space, with 
only nearest neighbor connections (the nearest neigh- 
bors are simply defined on a lattice, and can be defined 
via Voronoi tessellations for random node distributions 
(ll|): every node can establish one long-range connec- 
tion (shortcut) over the network with probability p. In 
this model, p allows to interpolate continuously between 
a fully regular (p = 0) and an entirely random (p = 1) 
topology, the precise nature of this transition being dis- 
cussed below. This "re- wiring" procedure can be accom- 
panied by a contemporary loss of one local connection 



of the re- wired node p|, without significant changes in 
the way the small- world topology emerges. We therefore 
deal with the model where re-wiring is not accompanied 
by edge removal. 

In the original formulation of the SW model, which re- 
ceived most of the attention |l2| , the length distribution 
of the shortcuts is uniform, since a node can choose any 
other node for re-wiring, irrespective of their Euclidean 
distance. Yet, new interesting properties emerge if this 
condition is relaxed, for example if the distribution q(l) 
of connection lengths I decays as a power law, q(l) ~ l~ a . 
The navigability in such a small-world, for example, de- 
pends on the corresponding decay exponent [l^ , and the 
nature of random walks over the network is also affected 
(l4|. It was even conjectured that the fundamental mech- 
anism behind the SW phenomenon is neither disorder nor 
randomness, but rather the presence of multiple length 
scales in agreement with q(l) ~ l~ a . 

Moreover, real-world networks are unlikely modeled a 
la Watts and Strogatz: if shortcuts have to be physically 
realized, the cost of a long-range connection is likely to 
grow with its length. Since nodes connected by short- 
cuts can be at any Euclidean distance from each other, 
it turns out that the amount of resources that they have 
to invest in their connections grows linearly with the sys- 
tem linear size, and it is, a priori, impredictable. This is 
far from optimal for systems composed by entities with 
limited resources [e.g., providers or neurons). Indeed, 
local (single node) and global wiring cost considerations 
are likely to be key factors in the formation of real SW 
networks El [H [S HIM E3 . Regarding connection- 
length distributions q(l) ~ l~ a , such measurements were 
reported for systems created through self-organization, 
design and evolution, namely for the Internet |2l| . inte- 
grated circuits , the human cortex [23| and for regions 
of the human brain correlated at the functional level ||. 
Some modeling effort taking into account the constraint 
of wiring minimization has been made for systems where 
the connection lengths are or are not distributed ac- 
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cording to a power law [25ll26Ll27| . and such length distri- 
butions emerge quite naturally when wiring costs along 
with shortest paths are minimized [28j| . 

In this Letter we re-analyze the SW phenomenon from 
a wiring cost perspective, for networks in D dimensions, 
built using a power-law decaying distribution of shortcut 
lengths. We find, both analytically and numerically, that 
a < D + 1 is the condition for the emergence of SW be- 
havior. We also show that, given a fixed total wiring cost, 
networks with larger values of a are both smaller worlds 
and more robust upon random removal of shortcuts. 

We construct our SW networks as follows. Given a D- 
dimensinal lattice (D — 1,2) of linear size L, consisting 
of N = L D sites, subject to periodic boundary condi- 
tions, we equip it with pN additional connections. For 
every such link, we first choose its length according to 
the distribution q(l) ~ l~~ a and then put it on the lat- 
tice by randomly choosing one endpoint and the other 
at distance I, such that no pair of sites is connected by 
more than one additional connection. For small values of 
p, our formulation of the model corresponds to the case 
where at every site, a link is added with probability p - 
the other endpoint being chosen as above. Yet, it has the 
advantage that p can be greater than 1 which allows us 
to look beyond the simple probabilistic version. Clearly, 
a certain amount of real shortcuts, i.e. long additional 
links, is required for SW topology to emerge. We there- 
fore expect that the length-distribution exponent a has 
to be smaller than a critical value a c . In order to find this 
condition, we look at the probability that an arbitrarily 
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FIG. 1: Mean distance versus linear system size, both of these 
quantities being rescaled by L%(p), for p — 0.001 (o), p — 
0.002 (□), p = 0.004 (A), p = 0.008 (o) and p = 0.016 (V). 
The exponent a ranges from to 3.5 as indicated. The data 
collapses confirm Eqs. and JI} also for a > a c (lower right 
panel) . 



chosen additional link is a real shortcut 

,L/2 

P C {L)= / q(l)dl, 

J(l-c)i/2 



(1) 



c being small but finite, and require the presence of the 
order of one such connection: 



P c (L)p*(L)L D ~ 1 



(2) 



where p*(L)L D is the desired number of shortcuts, imply- 
ing the emergence of SW topology for p 3> p*{L). After 
evaluating the scaling of the integral JU , Eq. (J2J) reads 



(L-° 
p*(L) ~ I \n(L)/L D 

[ L a-D-1 



if a < 1, 

if a = 1, (3) 

if a > 1. 



Eq. © implies the presence of a unique length scale 
L* a {p), suggesting that the mean distance can be ex- 
pressed as 



(d) = L*T a 



the scaling function obeying [29|, |3 



T a {x) 




if x<Cl, 
if x > 1 



(4) 



(5) 



where the second line of Eq. (JSJ may also read 
[\n(x)] s ( a \ s(a) > 0. In other words, SW topology im- 
plies that the mean distance increases only logarithmi- 
cally with the system size (L 3> L*) whereas in a large 
world (LW), (d) ~ L, i.e. if L < L* . For a < 1, Eq. 
© yields L*(p) ~ p~ x l D , a result which was previously 



derived for the special case a = |30ll3f| . The character- 
istic length scales as L*{p) ~ p 1 /!"-^ 1 - 1 ) f or a > 1, thus 
becoming infinite at a c = D + 1. We therefore have two 
possible regimes for a < a c while LW behavior prevails 
for a > a c . Fig. Q shows the rescaled mean distances as 
a function of the rescaled linear system size for diffcnt 
values of a and p — 0.001, 0.002, 0.016 in each set for 
the case D = 2. The observed data collapses for all the 
length-distribution exponents confirm Eq. J3J obtained 
by our simple argument as well as Eq. We numeri- 
cally verified Eq. J5J, especially in the limit L/L* <C 1, 
the logarithmic tail of T a further being exhibited best for 
small a. Previously, a c = D + 1 was derived by defining 
SW topology via the scaling of the clustering coefficient 
rather than by means of the scaling of distances • Our 
argument can be generalized for a model where a short- 
cut between any pair of sites x and y is added with a 
probability proportional to |x — y|~", finding a c = 2D in 
agreement with |3J| . which can also be derived through 
a rescaling argument [3] ■ 

The moments (I) and (^ 2 ) play a crucial role as far as 
the wiring costs of the networks are concerned. The total 
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TABLE I: Behavior of the moments of the shortcut-length 
distribution as a function of the linear system size L. 
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wiring cost Cw = pL D (I) is also an important quantity, 
its minimisation governing, for example, the evolution of 
cortical networks 01 • We find for the first two moments 
the scaling relations summarised in Tab. the expres- 
sions for integer a being modified by logarithmic correc- 
tions. In 2 dimensions, SW topology can be realized even 
if (I) = const (that is, for 2 < a < 3 = a c ) whereas this 
is not the case in 1 dimension where (l) becomes finite in 
the L — > oo limit only above a c — 2. Moreover, if D = 3, 
it is even possible to have (/) = 0(1) = (I 2 ) while still 
being in the SW regime for 3 < a < 4 = a c . An appro- 
priate choice of the parameters D and a is thus the key 
to constructing networks which are both efficient (SW 
topology) and economical (low wiring costs). 

It is furthermore interesting to have a closer look at 
the relationship between the wiring costs and the topol- 
ogy. As a varies, one can ask what mean distance results 
given a total amount of wiring length for the additional 
connections (i.e. the total cost). Fig. |2Ji reports these 
dependencies for a = 0,1,1.5 and 1.75 (going from the 
uppermost to the lowest set) for 1 dimensional topologies 
of 10 4 sites. The largest value of (d) (the leftmost circle) 
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FIG. 2: (a) Mean distance as a function of the total wiring 
costs (divided by the number of sites) for 1 dimensional 
topologies. The curves (o: a = 0, A: a = 1, O: a = 1.5 
and □: a = 1.75) show that the mean distance decreases 
with a for a fixed value of Cw/N. (b) Mean values and (c) 
relative standard deviations of the link betweenness central- 
ity at wiring costs Cw/N = 10 (circles) and Cw/N — 100 
(squares). The results shown in these 3 panels were obtained 
for lattices consisting of 10 4 sites and by averaging over 100 
realizations of the randomness. 



corresponds to the length scale L* < 10 3 -^i 10 4 = L, 
thus all the points in the figure represent the system in 
the SW regime. It can clearly be seen that the mean 
distance decreases with a at fixed wiring costs Cw/N, 
i.e. the larger a the smaller the world. This behavior is 
qualitatively recovered when expressing Eq. (0J in terms 
of x — Cw/N — p(l). We made similar observations in 2 
dimensions. 

In order to obtain a more complete picture, we also 
studied the implications of our model regarding the dis- 
tribution of flows over the additional links. The cor- 
responding quantity is the link betweenness centrality 
which is defined as 



(6) 



where tlab is the number of shortest paths between 
nodes A and B, and uab(s) counts only those going 
through connection s, the sum running over all pairs of 
nodes |35|. By using an efficient algorithm for the fee- 
computation |3jj, we obtained for 1 dimensional topolo- 
gies of 10 4 nodes with varying a but again fixed wiring 
costs the mean values (6 C ) and relative standard devia- 
tions <j{b c )/{b c ) (inset) shown in Figs. 03 andEt (upper 
sets: Cw/N = 10, lower sets: C w /N = 100). As Eq. ® 
can be transformed into (b c ) ~ (d)/E j^], E being the 
total number of links, and if the role of the links of the 
underlying lattice is ignored, (b c ) clearly decreases with 
a since both (d) and l/E ~ (pN)^ 1 = (l)/Cw decline 
with a at constant costs in agreement with the numerical 
findings. The fact that the higher a(b c )/(b c ) the larger a 
indicates that the extent to which shortest paths overlap 
is an increasing function of a as {b 2 ) relates directly - 
via Eq. © - to this topological property. This is very 
reasonable since the higher a the smaller the fraction of 
real shortcuts, i.e. those carrying the traffic. 

There is another important property, namely the be- 
havior of the networks with respect to link deletion. The 
associated concept, that is, robustness, can for example 
be defined as the extent to which the mean distance in- 
creases when a definite fraction of additional links is fail- 
ing. Two different types of failure can be distinguished. 
On the one hand, it is possible that certain connections 
are malfunctioning for whatever reason, resulting in ran- 
dom failures. The other scenario is directly related to the 
traffic on the network: in the most simple situation, ev- 
ery node sends one packet to all other nodes implying dif- 
ferent intensities of flows through the various additional 
connections. As the latter may only be able to carry flow 
amounts which lie below a certain threshold, overload of 
the long-range links occurs which is the second type we 
shall investigate. 

As far as random failures are concerned, Fig. illus- 
trates to what extent the mean distances of ID networks 
increase for C w /N = 10 (left) and C w /N = 100 (right), 
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FIG. 3: Robustness with respect to random failures. These 
figures show that the mean distance increases when a fraction 
q of the shortcuts is removed. The initial ID networks have a 
fixed cost: Cw/N = 10 (left) and Cw/N = 100 (right), and 
a takes on the values (o), 1 (□), 1.5 (o) and 1.75 (*). These 
results were obtained by averageing over 1000 realizations of 
networks consisting of L — 10 4 nodes. 



a taking the values 0, 1, 1.5 and 1.75 if up to 10% of the 
additional links are deleted. We find that for low costs 
(Cw/N = 10), a = corresponds to the most robust 
system, becoming more fragile as a increases. Yet, at 
high wiring costs (Cw/N — 100), the WS-type network 
(a = 0) is most vulnerable, and the robustness related 
to random failures undergoes an inversion between these 
two cost values, simply reflecting the non-trivial behavior 
of (d)(p). We observed an analogous effect in 2 dimen- 
sions. 

In the case of overload, we found the behavior to be in- 
dependent of the wiring costs of the initial network. The 
vulnerability always increases with a, that is, the rela- 
tive increase of the mean distance (caused by deleting a 
certain fraction of the most charged links) is lowest for 
a = 0. Tab. ITT1 illustrates this result for 2D topologies 
with wiring costs of the initial networks Cw/N — 10 and 
a removal fraction q — 10%. This finding is in agreement 
with the arguments given above in the context of flows. 
The higher a the smaller the fraction of real shortcuts 
carrying the majority of the traffic and making (d) small. 
As a consequence, (d) increases the faster upon their re- 



TABLE II: Overload-related robustness (simultaneous re- 
moval of 10% of the most charged shortcuts). The values 
shown here were obtained by simulating the process for 100 
different realizations of networks consisting of N = 100 x 100 
sites with initial wiring costs Cw/N = 10. The emerging 
picture is that networks with low a are most robust. 

a 12 3 

(<*)/(<% = 0)) 1.05 ±0.01 1.08 ±0.01 1.24 ±0.02 1.37 ±0.04 



moval the larger a. Furthermore, this result does not de- 
pend on the details of the overloading process: whether a 
given fraction of the most charged links is removed simul- 
taneously or the failure is accomplished in a cascade-like 
fashion, the dependency of the robustness from a remains 
unaltered. 

In summary, we have shown that small-world networks 
can be constructed in a very economical way if the pa- 
rameters D and a are chosen appropriately, also allowing 
for a more optimal distribution of costs over the nodes 
and flows over the links. We also obtained the non-trivial 
picture that the WS-type SW network is most vulnera- 
ble if a large amount of wire is available. In the case 
of overload, on the other hand, the length distribution 
alone fully determines the robustness, that is, networks 
characterized by a high value of a are most vulnerable. 
As length-distributions of the type investigated here have 
been observed in a number of real- world networks, such 
as integrated circuits, the Internet or the human cortex, 
we believe this work to have intriguing implications in 
their modelization. 
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